Nonlinear-Dynamical Attention Allocation via Information Geometry
نویسندگان
چکیده
Inspired by a broader perspective viewing intelligent system dynamics in terms of the geometry of ”cognitive spaces,” we conduct a preliminary investigation of the application of information-geometry based learning to ECAN (Economic Attention Networks), the component of the integrative OpenCog AGI system concerned with attention allocation and credit assignment. We generalize Amari’s ”natural gradient” algorithm for network learning to encompass ECAN and other recurrent networks, and apply it to small example cases of ECAN, demonstrating a dramatic improvement in the effectiveness of attention allocation compared to prior (Hebbian learning like) ECAN methods. Scaling up the method to deal with realistically-sized ECAN networks as used in OpenCog remains for the future, but should be achievable using sparse matrix methods on GPUs.
منابع مشابه
Controlling Combinatorial Explosion in Inference via Synergy with Nonlinear-Dynamical Attention Allocation
One of the core principles of the OpenCog AGI design, ”cognitive synergy”, is exemplified by the the synergy between logical reasoning and attention allocation. This synergy centers on a feedback in which nonlinear-dynamical attention-spreading guides logical inference control, and inference directs attention to surprising new conclusions it has created. In this paper we report computational ex...
متن کاملUsing Nonlinear Dynamical Attention Allocation to Focus Probabilistic Logical Inference Upon Relevant Information
In a previous article, the authors described a series of experiments combining probabilisitic logical inference with an artificial economics based attention allocation system. In those experiments, the authors compared their results with those from two standard examples chosen from the Markov Logic Networks literature. The examples were insufficient to determine the full usefulness of the integ...
متن کاملGuiding Probabilistic Logical Inference with Nonlinear Dynamical Attention Allocation
In order to explore the practical manifestations of the “cognitive synergy” between the PLN (Probabilistic Logic Networks) and ECAN (Economic Attention Network) components of the OpenCog AGI architecture, we explore the behavior of PLN and ECAN operating together on two standard test problems commonly used with Markov Logic Networks (MLN). Our preliminary results suggest that, while PLN can add...
متن کاملAnalyzing dynamical snap-through of a size dependent nonlinear micro-resonator via a semi-analytic method
In the present paper, the dynamical snap-through of a preloaded micro-sensor is analyzed. This behavior is linked to analyzing bifurcation behavior of the micro structure in a suitable framework. Effec...
متن کاملMultistage Modified Sinc Method for Solving Nonlinear Dynamical Systems
The sinc method is known as an ecient numerical method for solving ordinary or par-tial dierential equations but the system of dierential equations has not been solved by this method which is the focus of this paper. We have shown that the proposed version of sinc is able to solve sti system while Runge-kutta method can not able to solve. Moreover, Due to the great attention to mathematical mod...
متن کامل